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Summary 

When digital video information is carried on a communication circuit, some 
form of protection against the deleterious effects of errors is required. A concealment 
technique has limitations, particularly when d.p.c.m. coding is employed. The use 
of error correction coding, as distinct from error concealment, warrants investigation, 
and some of the many possible error-correcting codes are discussed. It appears that 
the Wyner-Ash (8, 7) code, with interlacing, is an efficient and relatively simple means for 
the correction of errors in digital video transmission. A description is given of an 
experimental error corrector using this system which has been constructed and shown 
to work satisfactorily. A companion report describes the evaluation of its performance 
by means of subjective tests with digital PAL colour television signals. 
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1. Introduction 

In a digital communication circuit, noise and distortion 
can introduce errors in the stream of digits decoded at the 
receiving terminal. For a digital video signal, the subjective 
impairment which results from transmission errors depends 
on the type of picture coding employed. With simple pulse 
code modulation (p. cm.), a single bit in error causes a spot 
on the display which is confined within the area of one 
picture element, and has a visibility related to the degree 
of significance of the erroneous bit. With differential 
pulse code modulation (d.p.c.m.) a single bit error causes 
a horizontal streak on the picture as the absolute value of 
all samples following the error remains incorrect until the 
system resets itself, which might be at the end of each 
television scanning line. 

Previous work^ concerned with p. cm. demonstrated 
a means of concealing the deleterious effect of digit errors. 
A single parity bit was added to each 8-bit sample word. 
When this parity check indicated that a sample was in error, 
a prediction of its correct value, based on neighbouring 
samples, was substituted. The prediction originally used 
was the previous sample (or the third previous sample for 
PAL colour signals when sampling at around three times 
subcarrier frequency). It has since been suggested that a 
slight increase in complexity may allow use of a better 
prediction, a simple example being the average of the third 
previous and third subsequent samples. Furthermore, a 
more complex decoding strategy may be applied if the 
parity checking is ordered differently.* However, although 

*A proposal by C.K.P. Clarke and the subject of British Patent 
Application No. 29516/74. 



this general technique is reasonably satisfactory for p. cm. 
encoded signals, it is unsuitable for d.p.c.m. coding where 
the correlation between adjacent samples has already 
been largely exploited. 

A logical development from such error protection 
is an error-correction scheme in which extra bits added to 
the data allow the processes of detection, location and con- 
sequent correction of bits received in error to be carried 
out, subject to certain limitations. A bewildering profusion 
of possible error-correcting codes is described in the litera- 
ture, each code having individual properties, and the choice 
of a code for a particular application requires consideration 
of a number of factors. These are the frequency and type 
of errors against which protection Is required, the permiss- 
ible increase in bit-rate resulting from the use of error- 
correction coding, and the complexity of the equipment 
required to implement the code. 

As yet, very little firm information is available on the 
error performance of digital communications links likely 
to be employed. Various ternary (three-level) codes are 
under consideration by the British Post Office (BPO) 
for a digital communications network using co-axial cable. 
When such codes^ are used, an isolated error introduced 
in the transmission path can cause a short group, or 
'burst', of errors in the decoded digital stream at the 
receiver. It therefore appears desirable to cater for 

short bursts such as this, which will be assumed to occur 
randomly. Overall bit-rate for digital video signals is at a 
premium — indeed considerable research effort is directed 
towards reducing it; therefore any error correction scheme 
must not unduly increase the bit-rate. The permissible 
degree of equipment complexity depends on the improve- 
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Fig. 1 - A digital communication circuit 



(EL-99) 



ment it provides and the number of units which would be 
applied in service. 

This report considers some aspects of error-correction 
coding relevant to digital video transmission and describes 
the experimental implementation of one error correction 
scheme. The subjective performance of this scheme is 



4 



described in another report. 



2. Error correcting codes* 

In this Section a simple introduction to the field of 
error-correcting codes will be given. The discussion is 
general, and any reference to digital data need not imply 
that it must be digital video information unless this is 
stated. Further explanation and details of particular 
codes may be found in Refs. 5 to 10. 

2.1 General introduction 

A digital communication circuit (Fig. 1) consists of a 
transmitter and a receiver connected by a transmission 
path over which messages may be sent as coded sequences. 



Disturbances in the transmission path may cause a sequence 
to be received wrongly so that the wrong message is decoded . 
The object of error-correction coding is to allow the 
receiver to determine the intended message although the 
received sequence may contain errors. Subject to restraints 
on the frequency and burst-length of errors, this ideal may 
be approached in practice. 

To achieve error correction some redundancy must 
be introduced; that is, more information must be sent than 
is necessary to specify the message uniquely. If there were 
no redundancy, every possible sequence would represent 
a different message, and it would be impossible to distinguish 
between an incorrect sequence and another correct one. 
The problem in error-correction coding is to code the 
messages into transmission sequences in such a way that 
an erroneous sequence can always be recognised because 
it would violate the coding rules and thus must contain 
errors. In the following, attention will be confined to 
binary systems in which any error corresponds to a simple 
inversion of a binary digit — or bit — i.e. an erroneous 
for a 1 or vice versa. 

2.2 Some definitions 



*A significant contribution to the work described in Sections 2 and 
3 was made by A. Brown. 



Suppose the input data is formed into blocks of k bits 
and that the information or 'message' corresponding to 



input 

sequence 

coded _ 

sequence 

decoded_ 

sequence 



-«-bits 
n bits 



fZ^ 



mzm 



b 

mzm 



Mzm 



d 

mzm 



wzm- 



k bits 



\Laim ujjxia YJJJJ-a izzzzzj vt(///\ xf////n vtf///r n 

^M ^B ^H m^ ^B ^H ^B---| 

___JL_,-™ _™_X__~ y,. l ,. .i| 3! i| - iii.. m, ««_~X_,,n=- r-y" J J J f H ~_~JL-— », B .:. y ii « i. X i y iii --y . J 



WM 



(a J 










coding 
operation 

decoding 
operation 



input _ 
sequence 



J., 

k bits 



-N blocl<v$- 



-H 



^mm 



^^ 



! L L 



mm—- 



coded _ 
sequence 



decoded _ 
sequence 



k bits 

^^ F777?7\ 



^^ 




coding 
operation 



decoding 
operation 



(bj 



Fig. 2 - Illustrations of block and convolutional codes 

(a) An (n,k) block code (bj An (n,k) convolutional code, with a constraint length of N blocks 

(The symbol |__^_J denotes that block 'a' is formed taking into account the information contained within the braces). 



(EL-99) 



-2- 



each block of k bits is coded into a sequence of n bits, 
where n>k, and the n bits have been determined from the 
original k bits by a set of rules. This broadly defines the 
coding operation, and a code using these rules would be 
referred to as an (n, k) code. There may however be many 
codes having the same values of {n, k) and some classification 
of the different types of codes is necessary. 

If the set of rules is such that the n bits comprise the 
original k bits unaltered, plus a further (n-k) bits, the 
code is called systematic . Commonly, the k unchanged 
bits are referred to as data, and the (n-k) additional bits as 
parity or check(ing) bits. Conversely, if the n bits do not 
include the original k bits in unaltered form, the code is 
said to be non-systematic. 

The other main distinction is between block and 
convolutional codes. If the n bits in a coded block are 
formed solely by reference to the k bits of the corres- 
ponding block of input data, the code is a block code. 
At the receiving terminal the original k bits will be 
obtained by reference only to the corresponding coded 
block of n bits. With a convo[utional*code the n bits 
of a particular block will be formed by reference both to the 
corresponding block of k input bits and also to several 
previous input blocks, TV blocks in all. The span of A'^ 
blocks is known as the constraint length of the convolutional 
*sometimes called recurrent code 



code. Similarly, in decoding, each block of k bits will be 
obtained by reference to A'^ blocks of n bits of the 
received signal. Fig. 2 shows the distinction between 
the block and convolutional codes. 

2.3 Further discussion of code classification 

Both block and convolutional codes may be syste- 
matic or non-systematic, hence four possible classes of code 
may be distinguished by the above definitions. It can be 
shown that any non-systematic block code may be trans- 
formed into a systematic block code of the same performance. 
As systematic codes are clearly easier to understand and 
implement, there is little to be said for considering a non- 
systematic block code for practical applications. However, 
the same transformation may not in general be made for 
convolutional codes, and non-systematic convolutional 
codes have been shown to have some theoretical advantages. 
The comparison of systematic and non-systematic codes is 
discussed further in Reference 5. 



Since systematic codes are the simpler type, it is 
convenient here to compare the operation of block and 
convolutional systematic codes. Fig. 3 is Fig. 2 re-drawn 
for the particular case of systematic codes, and shows the 
resulting simplifications. The coding operation is reduced 
to handing on the k data bits and adding to them (n-k) 
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parity bits. For a block cocle,tliese are formed by reference 
to the k data bits of the block, and for a convolutional code 
by reference to the data bits of the block and of some 
previous blocks making N blocks in all. To decode the 
block code reference is made to the n bits of a coded block 
to form the k bits of the decoded block. To decode the 
convolutional code, reference is made to the k data bits 
of the coded block and to the parity bits of a total of// 
blocks. This straightforward technique is known as 
algebraic decoding. Other methods of decoding convolu- 
tional codes are possible which can achieve somewhat 
better performance in some circumstances; these are forms 
of probabilistic decoding. This is discussed at considerable 
length in the literature, including References 5 to 8, but it 
appears that sheer instrumental complexity rules out such 
decoding for digital video signals. 

2.4 Error detection by parity checking 

To permit detection of single errors in a given sequ- 
ence, a parity bit may be generated in the coder by the 
simple rule of modulo-2 addition. This is defined by: 
0H-0 = 0, + 1=1-^0 = 1, 1 + 1=0. It is equivalent 
to the 'exclusive-OR' function used in logic, and is often 
represented by the symbol ®. Thus the parity bit will be 1 
if the number of 1's in the data sequence is odd, and if it 
is even; it will make the modulo-2 sum of the transmitted 
sequence (including the parity bit) 0.* At the receiver, 
the modulo-2 sum of all the bits in the sequence including 
the parity bit is calculated. If the result is 1 then at least 
one error must have occurred in the transmission within the 
sequence. If the result is then there is a high probability 
of zero error under normal conditions, with a remote 
possibility of two, four etc. errors. 



2.5 Single-, multiple- and burst-error-correcting codes 

Code performance can be classified according to the 
number of errors occurring within a given period that the 
code can correct. The relevant period is the block length 
for a block code, and the constraint length for a convolu- 
tional code. A code is said to be e-tuple error-correcting if 
it can correct any e errors occurring within these periods. 
Clearly for a given length of code, as e increases, the propor- 
tion of redundant information added to the required data 
must increase. It will be useful to define redundancy** 
R by 

{n-k) 

R = 



R has values in the range to 1; if data is sent with 
no protection R=0, and as more complex coding is applied 
(which could increase e for a given length of code) R will 
approach 1. 



*This defines even parity: if the transmitted parity bit is tlie inverse 
of that defined above, so that the modulo-2 sum of the bits of the 
transmitted sequence is 1, then the system is said to use odd parity. 
**Other definitions are possible and are sometimes met in the 
literature. 



It may be that errors in a particular channel tend to 
occur in groups or bursts, e.g. when interference pulses 
last for several bit-periods. A single-error-correcting code 
could not correct such errors and it might appear that the 
complication of an e-tuple-error-correcting code, where e is 
equal to the possible burst length in bits, would be 
necessary — possibly entailing a prohibitive increase in R. 
However, there are some codes, known as 'burst-error- 
correcting' codes, which can correct short bursts of errors 
provided that these bursts are always separated by a mini- 
mum period known as the 'guard space'. These codes could 
not correct the same number of errors distributed randomly 
in the same period, and this restriction of the performance 
makes a lower redundancy possible. 

Another approach to burst-error correction is given by 
interlacing. 

2.6 Interlacing 

A single-error-correcting code may be made into a 
burst-error-correcting code by a technique known as inter- 
lacing. Before coding, the continuous input bit stream is 
split (i.e. demultiplexed) into b separate streams, to each 
of which a single-error-correcting code is then applied. 
The streams are then recombined (multiplexed) for trans- 
mission. Decoding is performed similarly and any burst 
of b or less errors occurring during transmission will now 
cause only a single error in each stream, which can thus be 
corrected. Fig. 4 illustrates this with four streams; 

a (4,3) systematic code is assumed for simplicity of presen- 
tation. (Note that any number of streams, and any type 
of single-error-correcting code could be employed*). In 
this example, if any four or less consecutive bits in the 
coded output stream were subsequently received in error, 
only single errors would occur in each of the demultiplexed 
streams, so that each error is correctable by the single- 
error-correcting code employed. 

There does not appear to be any significant disadvan- 
tage in using the interlacing technique in preference to a code 
which has an inherent burst-error-correcting capability; 
indeed, there may be some instrumental advantages. For 
example, each coder operates at only 4- of the input 
stream bit rate — a significant advantage at the speed 
required for digital video signals. 

2.7 Effect of decoding failure 

When comparing the performance of different codes, 
it is essential to know the nature of the decoding failure 
which results when more errors occur than the code is 
capable of correcting. Block and convolutional codes differ 
in this respect. 

With a block code, each block is considered independ- 
ently of all others. Suppose the code is an e-tuple-error- 
correcting code of the most efficient form. Then, if t 
errors {t > e) occur in one block, the received sequence can 
be regarded as a sequence corresponding to a different 

*lf an e-tuple-error-correcting code is used, bursts of up to (e X h) 
errors can be corrected. 
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message from that sent and containing a number of errors 
equal to or less than e* The decoder will then act to 
"correct" these e or less "apparent errors", and, as all the 
bits corresponding to these "errors" might well have been 
correct, the decoded output could contain up to (e + t) 
errors in this block. To summarise, when the number of 
errors occurring in a transmitted block is e or less, the 
decoded output block will be free of any errors; when 
the number exceeds e, the decoded block may contain 
more errors than those introduced during transmission. 
This effect will be called error extension — a term not gen- 
erally approved, but one which will serve here to distinguish 
it from another effect to be described. Error extension for 
a block code is confined within the block which contained 
the excess of transmission errors. 



An analogous argument demonstrates that convolu- 
tional codes can similarly give more decoded output errors 
than transmission errors. However, the detail of the argu- 
ment now depends on the type of decoding (i.e. algebraic 
or probabilistic) applied, as well as the structure of the 
particular code. Consider first that algebraic decoding is 
employed, so that each block of k bits of the decoded 
output is obtained by reference to N blocks of n bits of 
the transmitted signal. Correct operation, with no errors 
in the decoded output, will be obtained provided that any 
group of A'^ consecutive transmitted blocks contains no 
more than e errors (for an e-tuple-error-correcting convolu- 
tional code). Note that this is not the same condition as for 
a block code of block length n or nN, nor is it the same as 
saying any group of nN consecutive bits may contain no 
more than e errors (these are both fairly common miscon- 
ceptions). Fig. 5 illustrates this point. 



When the above condition for error-free decoding is 
violated a kind of error extension will occur whereby errors 
will occur in the decoded output within the span of one 
constraint length. An effect known as"error propagation" 
may also occur with convolutional but not block codes; 
the term does not seem to have a unique rigorous definition 
in the literature and seems to be applied in two situations; 

(a) the decoded output may still contain errors after 
more than one constraint length has elapsed following 
uncorrectable transmission errors, but becomes error- 
free again in a finite time (this is really a modified 
form of error extension); 



and 



(b) as for (a) but the output never again becomes error- 
free. This unsatisfactory state is sometimes known 
as "catastrophic error propagation". 



* This must be so or the code would be capable of recognising the 
occurrence of more than e errors, and would then be either e-tuple- 
error-correcting and f-tuple-error-detecting, or Muple-error-correc- 
ting. A code might be envisaged which corrected all e-tuple errors 
while detecting or correcting only some f-tuple errors. This would 
then be an Inefficient code for e-tu pie-error-correction as it would 
not have minimum redundancy. 



Catastrophic error propagation cannot occur for a 
systematic code. Furthermore, for some non-systematic 
codes in which it can occur, a decoder may be designed 
which avoids error propagation but at some expense in 
error-correcting performance. The performance of a 
probabilistic decoder ' for convolutional codes in the 
presence of an excess of errors is less clear-cut: the decoder 
will try to produce the most likely transmitted sequence 
in the situation. A kind of catastrophic error propagation 
may be possible but the decoder will normally be designed 
to prevent this. 

2.8 Some examples of error-correcting codes 

A systematic single-error-correcting code may be 
constructed by performing several parity checks over 
selected groups of bits in the sequence so that each data 
bit is checked at least twice. At the decoder the same 
parity checks are repeated and a syndrome (or checking 
number) is formed which contains 1's where the checks 
failed and O's where they were successful. The groups 
of bits involved in each parity check may be selected in 
such a way that the syndrome bits indicate the position 
of an erroneous bit, which can then be inverted and 
thereby corrected. 

Two series of systematic codes of this form, one 
block, the other convolutional, will now be considered. 
Each is an optimum single-error-correcting code of its class, 
that is to say, for a given value ofn, the redundancy is the 
minimum possible that will permit single error-correction. 
Both require relatively simple instrumentation. 

The codes may be concisely and elegantly described 
using matrix algebra, but as this form of analysis is given in 
most text books on the subject, an attempt has been made 
to present a simpler (but lengthier) mathematical description 
using only basic algebra in Appendix, Sections 7.2 and 7.3. 

2.8.1 Hamming codes 

These were proposed by Hamming* in 1950. 
They are optimum single-error-correcting block codes 
which may be constructed for values of («, k) satisfying 
the equations below.** 



« = 2"^ - 1 
k = (n-m) 



where m is any integer 



The number of parity bits per block is 

(n ~ k) =n — [n- m) = m 

Each of the (n — k) parity bits is a simple parity check over 
a particular selection of the data bits within the block. 
At the decoder, a syndrome of {n-k) bits is formed which 
indicates in binary form the position of any single error 



*Note that the notation used here is different from that used by 
Hamming {k and m interchanged, R defined differently). 
**Codes may be constructed for other values of n which are 
degenerate versions of that code having the next highest value of n 
satisfying the equation above. 
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within the associated block. If no errors are present the 
syndrome contains all O's and no corrective action is taken. 

It is of interest to note that the Hamming code is 
optimum since no single-error-correcting block code can use 
fewer parity bitis than the number specified by the above 
equations. This follows because one error in 2"^ bits could 
be in any one of 2^ possible positions which require 
m bits to describe them. However, the code must also 
allow for the 'no error' condition; thus the number of 
bits in the block must be reduced by one and becomes 
2^" — 1 as given in the above equation for the Hamming code. 



Since the details of the system are very clearly pre- 
sented in the paper by Hamming, these codes will not be 
described further here. 

2.8.2 Wyner-Ash codes 

These are optimum single-error-correcting convolu- 
tional codes which may be constructed for values of 
(n, k] satisfying the equations below. 

n = 2*^ where q is any integer 
fc = 2'' - 1 =«-1 

The constraint length is then N = q+^ blocks. Since 
(«— /c) = 1, each transmitted block of n bits contains one 
parity bit which relates to a particular selection of the 
data information within A'^ blocks. 



then any one transmission error will, in the first place, 
cause the received and re-calculated parity bits for this 
block to differ, giving a syndrome 1 . 

Consider the 3rd bit of the /th block. Fig. 6 shows 
that this bit will be checked by the parity bits of the /th, 
(/ + 1 )th and (/ + 2)th blocks, but not that of the (/ + 3)th 
block. Suppose now that an isolated error is introduced 
in this bit during transmission. The received parity bits 
will be assumed to be received intact, and so will not have 
changed. Then the re-calculated parity bits, which are 
derived from the received data including the one erroneous 
bit, will be changed for the /th, (/ + 1)th and (/ + 2)th 
blocks, but not the (/ -i- 3)th block. The syndrome bits will 
thus be 1's for the /th, (/ + 1)th and (/ + 2)th blocks and 
O's for all other blocks, as shown below:— 

block syndrome 



(/-I) 

/ 
(/+1) 
{1 + 2) 
(1 + 3) 





1 — this means there is an error in /th block 
these give the location of the error with- 
the /th block, in binary coded form, 
' LSB first. 



1 X the 

1 Sin 
n / I c; 



The operation of the codes with algebraic decoding 
will be demonstrated by means of an example — the (8,7) 
code, for which: 

n = 8,k =7,7V=4 

The parity bit for one block is formed as the modulo- 

2 sum of all the seven data bits in that block and of four 
data bits from each of the three previous blocks. The 
choice of bits used in this summation is illustrated in Fig. 6 
in which successive blocks are shown in horizontal rows 
so that the bits in corresponding positions in successive 
blocks form vertical columns. The pattern of black 
circles on the diagram indicates which data bits are used to 
form the parity bits for the /th block. It may be seen that 
the pattern of the black or white circles for blocks (/— 3), 
(1—2), and (1—1) in each of the seven columns headed 1, 2, 

3 ... 7 gives a binary representation of the decimal 
number heading each column, taking the bit in block 
(/— 3) as the most significant bit and that in block (/—I) 
as the least significant bit. This property of the pattern 
is used in decoding. 

In the decoder, a syndrome bit is formed for each 
block by comparing the received parity bit with a re- 
calculated parity bit derived from the received bits accord- 
ing to the same rule as used in the coder. Clearly, if there 
are no errors introduced by the transmission path, these 
two parity bits will correspond for every block and the 
syndrome bits will all be O's. Since every data bit is 
checked by the parity bit of the block in which it occurs, 



The first 1 is interpreted as: "there is an error in this 
block'; the remainder, 110, gives, in binary notation, the 
location of the error within the block, LSB first, (Oil 
binary = 3 decimal). 

Similarly, it can be shown that for any error position, 
if an isolated error occurs in the xth bit of the /th block, 
the syndrome bits will be: 



/th 1 

(/ + 1 ) th A 

(/ + 2) th B 

(/ + 3) th C 



CB A binary =x decimal 



This arises from the binary pattern of bit checking; a 
more formal derivation of the operation of a Wyner-Ash 
corrector is given in the Appendix, Section 7.3. 

As the /th to (/ + 3)th parity bits are used to find an 
error in the /th block it follows that for this system to be 
successful there must be no further errors within those 
blocks, i.e. only one error present within any four blocks. 
This is the limitation of the code — it is single-error-correct- 
ing, for any single error within the space of four blocks, 
which contain 32 digits. Note that if the single error were 
to occur in any received parity bit then the resulting 
syndrome bits would be 1000, the 1 indicating the presence 
of an error and the three zeros indicating that the error 
was not in the data bits but in the parity bit, which can be 
regarded as bit position zero in the block. Thus no indep- 
endent protection of the parity bits is required. 
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Fig. 6- Illustration of Wyner-Ash (8,7) code 

X — parity bit o — data bit 

parity bit ^\ is tfie modulo— 2 sum of the bits marl<ed ' 



If more than one error occurs within the span of a 
constraint length then incorrect decoding will result — the 
exact form taken depending on the relative positions of the 
errors. Two errors will cause some syndrome pattern iden- 
tical to that produced by a different single error E, say. 
The decoder cannot distinguish between these cases and 
thus tries to correct the single error E. However, this 
error has not in fact occurred, so that in trying to correct 
it another error is introduced in addition to the original 
two errors which pass through uncorrected. Thus, in 
general, a double error has caused three errors in the de- 
coded signal. The overall effect is not quite this simple. 
For example, if an error is indicated in a parity bit no 
action is taken, so that on average the figure for decoding 
errors per double error must lie between 2-0 and 3-0. 

The operation for the general case of Wyner-Ash 
codes with other values of (n, k) is similar; the parity 
checking pattern consists of a binary count as above but of 
appropriate size to cover the particular value of n. 
The number of syndrome bits employed to correct one 
block will change correspondingly. 



3. Choice of error-correcting code and format for 
digital video signals 

3.1 Factors influencing choice 

The choice of the appropriate error-correcting code for 
a given application depends on several factors. The 
important, and usually conflicting, factors appear to be: 

(i) error-correcting performance — the relation between 
transmission path error rate and decoded error rate; 

(ii) the redundancy required to achieve a given performance; 

(iii) the complexity of the equipment required to imple- 
ment the code; 



(iv) the form and rate of errors that the code must deal with 
in the practical application. 

Some estimate of the permissible decoded error 
rate may be made from previous work on random errors, 
but care is needed as the subjective effect of errors caused 
by decoding failure may not be the same as for random 
errors of the same frequency of occurrence. However, the 
required code performance is still not specified until the 
error rate for the transmission channel is known. 

The permissible redundancy depends on the type of 
channel to be used, although it seems to be generally true 
that the lower the bit rate, the lower the cost of data 
transmission. The starting point chosen was to try to 
achieve a measure of error correction with a lower redun- 
dancy than that employed in the simple error detection 
and concealment technique previously developed, which 



used one parity bit added toeach 8-bit word,i.e.i? = 4-= 0-111. 
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Equipment complexity raises two questions: 

(i) At the speeds involved in digital television, is imple- 
mentation of the error-correcting code in question 
possible at all? 

(ii) Is the error-correcting equipment sufficiently simple 
that its cost, including the cost of its maintenance, 
still permits a saving compared with paying more for 
a more error-free transmission link, if the latter option 
is available? 

Only single-error-correcting codes, and simple multiple- 
error-correcting block codes appear to allow a simple 
analysis of their performance (see Appendix 7.1). IVIore 
complex codes, including non-systematic convolutional 
codes with probabilistic decoding seem to offer the pros- 
pect of higher performance but the instrumentation of 
these appears to be far too complex for any further 
consideration here. 

The type of transmission code'^ or modulation system 
employed within the digital transmission link usually 
necessitates protection against the occurrence of short 
bursts of errors. This could be achieved, with instrumental 
complication, by multiple- or burst-error-correcting 
codes ' ' or as discussed in Section 2.6, by interlacing a 
single-error-correcting code using less complex instrumen- 
tation. The latter technique has distinct advantages when 
applied to the high-speed signals required for digital 
video. Suppose the number of interlaced codes is chosen 
to equal the number of bits in one sample word. Inter- 
lacing is then equivalent to applying a single-error-correcting 
code separately to bits of each weight in the sample words. 
The coding operation can now be carried out in parallel 
form at reasonable speeds before the signal is serialised 
for transmission. 

A further advantage accrues from interlacing because 
of the relative visibility of errors in bits of different weight. 
When 8-bit p.c.m. is employed, errors in the less significant 
bits are subjectively much less annoying than those 
in the more significant bits. With interlacing it 

is easy to apply error correction to the more sign- 
ificant bits and no correction to the less significant 
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bits. In this way the overall redundancy, and thus 

the transmission bit-rate, can be reduced. This ad- 
vantage may not apply to other forms of picture coding; 
for example, an error introduced in a d.p.c.m. signal will 
affect more than a single picture sample, making low-signi- 
ficance-bit errors more visible. 



pattern of transmission errors occurs which cannot be 
corrected. Effectively, a quantifies the 'error extension' 
effect discussed in Section 2.7. 

In the Appendix, Section 7.1, it is shown, with the 
assumption that p is small, that 



Interlacing is thus seen to provide a measure of 
burst-error-protection, to allow some instrumental simpli- 
fications, and to permit correction of bits of greater 
significance only, where this is known to be adequate from 
subjective tests. Bearing in mind the considerable com- 
plexity of burst- and multiple-error-correcting codes, one 
is led to the choice of a single-error-correcting code, inter- 
laced as suggested so that the selected bits of the sample 
words are in effect error-coded separately. 

It now remains to choose the particular single-error- 
correcting code. 

3.2 Choice of single-error-correcting code 

The Hamming and Wyner-Ash codes previously men- 
tioned appear to be the most suitable single-error-correcting 
codes for the present application, on the grounds of simpli- 
city and efficiency. To choose one particular code from 
this group it will be necessary to introduce some terms to 
describe code performance. Let the probability of any 
bit being in error, be p; i.e. the transmission-path error- 
rate is one in — bits. 
P 

We may define the following terms. 

Code failure rate , p = probability of a decoding 
failure (due to an uncorrectable error pattern).* 
It is the reciprocal of the mean time between uncorr- 

1 1 

ectable errors, measured in bit periods. 

Decoded error rate , p. = probability of a bit error 
in the decoded data output, i.e. the proportion of 
erroneous bits in the decoded data output. 

It will be seen that p.=ap where a is the average 
number of errors produced in the decoded output when a 



*This Is expanded in the Appendix, Section 7.1. 



p = P p for Hamming and Wyner-Ash single-error-correct- 
ing codes, where j3 is a coefficient particular to the code 
concerned. Clearly for these codes: 

Pd = a |3 P^ 

For most codes of either class a will lie between 2-0 
and 3-0* so that comparisons of code performance may be 
made using j3 as a criterion. Note that any two such codes 
may be compared without specifying p or p . (This 
simplification does not hold true if valid comparisons are 
to be made between a single error-correcting code for 
which p '^ P p and an e-tuple-error-correcting code for 
which pj«)3'p'^ +^'.) 

Analytical expressions for |3 for the codes considered 
are derived in the Appendix, Section 7.1; some values 
of P, along with other relevant parameters, are listed in 
Table 1 below. 

The Table shows that for a given/?, a Hamming code 
offers slightly better performance (in terms of a lower |3). 
However, there is also the question of complexity. The 
basic coding and decoding operations will be considered 
first, ignoring the need to multiplex the parity bits 
together with the data. 

A measure of equipment complexity is the number 
of logic elements required. A Hamming {n,k) coder 
requires about n flip-flops and about («-fc) gates,** a Wyner- 
Ash {n,k) coder requires about (k+N) flip-flops and aboutA^ 
gates. The decoder for each includes a coder, but the 
overriding requirement is the necessary storasp — for 






"a'ls less than 2-0 for very redundant codes *• 
**An alternative configuration is possible which uses fewer storage 
flip-flops, in exchange for an increase in the number of gates, and 
also much more complicated control circuits. The resulting overall 
complexity is deemed to be similar. 



Table 1 



Hamming (H) 


Wyner-Ash (W-A) 


(n,k) 


^ 


R 


(n,k) 


N 


nN 


/? 


R 


( 7,4 ) 


3 


0-429 


( 2,1 ) 


2 


4 


272 


0-5 


( 15,11 ) 


7 


0-267 


( 4,3 ) 


3 


12 


QV2 


0-25 


( 31,26 ) 


15 


0-161 


( 8,7 ) 


4 


32 


27% 


0-125 


( 63,57 ) 


31 . 


0-095 


(16,15) 


5 


80 


IV/z 


0-063 


(127,120) 


63 


0055 


(32,31) 


6 


192 


175ya 


0-031 


(511,502) 


255 


0-176 
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Hamming this is n flip-flop stages and for Wyner-Ash 
nN stages. The number of flip-flops, being greater than 
the number of gates, is thus a useful measure for these 
codes. 

Performance considerations (see Section 3.1) suggest 
that the codes of relevance to digital video signals are the 
W-A (8,7), the H (31,26) and the H (63,57) codes. Their 
performance is summarised below in Table 2 with an 
approximate indication of complexity — the number of 
flip-flops for a codec (coder and decoder combination). 

Table 2 



Code 


P 


R 


'Complexity' 
(codec flip-flop stages) 


W-A{ 8,7 ) 
H (31,26) 
H (63,57) 


15 
31 


0-125 
0-161 
0-095 


43 

62 

126 



It should be noted that the data/parity multiplexing 
operation so far neglected is also slightly more complicated 
for Hamming codes. 

H (31,26) offers best protection against errors (i.e. 
lowest (3), but requires highest redundancy R. W— A 
(8,7) offers less protection against errors but redundancy 
and complexity are both significantly lower, whereas H 
(63,57) is only slightly worse still in performance, for an 
even lower redundancy, but is much more complex to 
instrument. At this point it should be noted that the 
previous work on impairment caused by digit errors 
indicated that the subjective impairment is more nearly a 
linear function of the logarithm of the error rate than of the 
error rate itself. This suggests that in making a choice 
of an error-correcting code more weight should be attached 
to redundancy and complexity, which have directly related 
costs, than to a factor of around two in /3, which represents 
a relatively small change in visible impairment. On this 
basis the W— A (8,7) code was chosen for implementation 
in an experimental codec* 

To emphasise that there is no generally 'best' code, 
but ratheravariety of codes, each appropriate to a particular 
application, brief mention will be made of the choice of 
code for the BBC CEEFAX project. Protection of some 
kind is required for an address code which precedes other 
data. As this address represents a small fraction of the total 
data transmitted, the permissible redundancy of any error- 
correcting-code applied to it is not unduly restricted. The 
address code and associated data which it identifies, 
constitute a group; a sequence of such groups is sent 
repeatedly, the data remaining unchanged for many repeti- 



*This discussion has centred on correction systems with similar 
redun(jancy to the error concealment technique previously investi- 
gated. In applications where low redundancy is of prime impor- 
tance the Wyner-Ash codes of higher values of (n,k) are attractive, 
for example the W— A (16,15) code which has a 'complexity' 
of about 100 flip-flops. 



tions of the sequence. Thus a badly corrupted address 
code (i.e. more than one error per address) need not be 
corrected provided that it can be detected. In this event 
the data corresponding to the corrupted address code is 
skipped and is obtained when the sequence repeats. 
However, some measure of error correction is necessary 
as the possible error rate is such that groups might otherwise 
be skipped too frequently. Because of the isolated nature 
of the address code it is preferable to use an error- 
correction strategy which is confined within each address 
code, i.e. a block code. A convolutional code is not 
suitable since its operation would be necessarily distri- 
buted over several address codes. 

A particularly suitable selection of codes is thus the 
series of single-error-correcting double-error-detecting block 
codes which can be obtained by adding one extra parity 
bit per block to the Hamming codes. The code used 
is an (8,4) Hamming code, i.e. a (7,4) code with one 
extra parity bit per block, as discussed above. 

3.3 Choice of format 

Some codes in Table 2 have values of R which are 
greater than the target figure of 0-111 mentioned in 
Section 3.1. If, however, not all of the data bits need to 
be corrected, these codes may be arranged to have a 
lower effective R value by the use of an appropriate 
format. Although presented separately here, the choice 
of code and its format for digital video signals was really 
an integrated problem. 

The use of interlaced codes, principally to gain 
protection against error bursts, also makes it possible 
to exploit the smaller subjective impairment which results 
from errors in the less significant bits of a p. cm. video 
signal. The application of error correction to the four 
most significant bits only of each 8-bit data word in such 
a signal is particularly convenient, as will now be explained. 

The Wyner-Ash (8,7) code, chosen in Section 3.2, 
produces one parity bit for every seven data bits. Thus, 
if applied individually to each of the x most significant 
bits of 8-bit p.c.m. sample words, there will be x parity bits 
produced with every seven sample words. Simpler data/ 
parity multiplexing is possible if the parity information can 
be inserted as whole 8-bit words, and this may be done for 
X = 8, 4, 2 or 1. If all eight data bits are corrected, then 
one parity word of eight bits is produced for every seven 
sample words — representing a redundancy of g- = 0-125, 
which was considered to be too high. If the four most 
significant bits are corrected, four parity bits are produced 
for every seven sample words, i.e. one whole 8-bit parity 
word could be made per 14 sample words. This corres- 
ponds to an overall redundancy of jg = 0-067, which is 
well within the original target of 0-111. The further 
diminution of x need not be considered as this would 
involve too great a picture degradation in the presence of 
errors. 

It was thus decided to apply correction to the four 
most significant bits, pairing two successive groups of 
four parity bits to make an 8-bit parity word. This pairing 
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Fig. 7 - Format for Wyner-Ash error correction scheme for 
8-bit p. cm. video signals 

Parity bits 1A, 2A, 3A, 4A check columns 1, 2, 3, 4 respectively in 
block A and the three preceding blocks. Parity bits IB, 2B, 3B, 
4B check columns 1, 2, 3, 4, respectively in block B and the three 
preceding blocks. Columns 5—8 of data bits receive no error 
correction 



slightly reduces the burst-error immunity. The resulting 
format is shown in Fig. 7 - the parity word is sent before 
the corresponding data for instrumental convenience; this 
does not affect the total storage requirement. If a sampling 
frequency of three times colour subcarrier frequency is 
employed the final serialised data rate is 114 Mbits/s. 



4. The experimental Wyner-Ash codec 

An experimental codec for 8-bit p. cm. video signals, 
using the code and format described in Section 3.3, has 
been constructed. A brief description of it follows; 
subjective tests on the performance are described in 
Reference 4. 



4.1 The basic Wyner-Ash (8,7) coder 

This is shown in block diagram form in Fig. 8. The 
input data corresponding to one of the parallel streams 
passes through the seven-stage shift register so that at 
intervals of seven clock periods the register contains a 7-bit 
block of input data. The other flip-flops, which are 
involved in generating the parity bit, are then clocked. The 
parity bit is formed by a succession of partial sums to 
avoid having to store N blocks of input information. 
Note that the pattern of connections between the register 
and the adders corresponds with the parity-checking 
pattern of Fig. 6. 



4.2 The experimental digital video error-correcting coder 

This is shown in block diagram form in Fig. 9. 
It contains four basic coders as described in Section 
4.1, one for each of the four most significant bits. As the 
input digital video data is in 8-bit words in parallel form, 
the de-multiplexing operation mentioned in Section 2.6 
has effectively already been performed. The four 

least significant bits^ are passed through shift registers 
of delay equal to that of the coding process so that the 
data bits remain isochronous. As described in Section 
3.3, four parity bits are produced for every seven 8-bit 
words taken in, and they are stored so that two successive 
sets of four parity bits can be grouped together to form an 
8-bit parity word. A parity word will thus occur once 
every 14 input data words, and it is inserted into the parallel 
stream by the multiplexing circuit. As the input data word 
rate is nominally three times subcarrier frequency, i.e. 
about 13-3 MHz, the multiplexed word rate is 



15 

14 



X 13-3 = 14-25 MHz. 



This multiplexed 8-bit signal is then serialised to produce 
a serial stream at 114 Mbit/s. This parallel-to-serial 
conversion is based on previous work. 

4.3 The basic Wyner-Ash (8,7) decoder 

This is shown in block diagram form in Fig. 10. 
Its function is to take in the received data and parity 
bits, and then perform the appropriate operations in order 
to correct any errors in the received data. It contains 
a basic coder, as descrited in Section 4.1, which forms 
re-calculated parity bits from the received data. These 
re-calculated parfty bits are compared with the received 
parity bits to form the syndrome bits, one to each 
block of seven data bits. The syndrome bits are then 
stored in a four-stage shift-register. In order to allow 
time for the necessary syndrome bits to be formed, the 
data bits are passed through a total delay of 28 bit- 
periods provided by shift-registers, including the seven 
stages present within the basic coder. When a 1 reaches 
the last stage of the syndrome register it indicates that 
there is an error in the block which currently occupies the 
last seven bits of data storage; the position of the error 
within the block is indicated by the contents of the other 
three stages of the syndrome register. A -^ 7 counter, 
the "syndrome counter", is clocked at the same rate as 
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Fig. 8 - Basic Wyner-Ash (8,7) coder 



the data register so that its state indicates which bit 
of a block is present at the output of the 21 -stage data 
register. When the syndrome counter state is equivalent 
to that of the syndrome register, the output data bit is 
inverted, thus correcting the error. The syndrome 
register is then reset to 0000. 



4.4 The experimental digital video error-correcting 
decoder 

This is shown in block diagram form in Fig. 11. 
It is similar to the coder of Section 4.2 but operates in 
reverse, with the basic decoder circuit of Section 4.3 
replacing the basic coder. The serial-to-parallel converter 



is based on previous work 
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Each basic decoder is equipped with a switch so that 
the error-correction facility may be disabled. Error 
correction may thus be applied to any desired combination 



of the four most significant bits. 

4.5 Experimental set-up and objective performance 

In experimental use, the serial output from the coder 
was fed to the decoder via an error-inserter unit. This 
was able to introduce single or burst errors at various 
rates into the serial stream, so that the performance 
of the codec could be assessed. The error inserter is 
further described in Reference 4, which also describes 
the subjective testing of the codec. 

An objective performance test was made which effect- 
ively assessed the performance of one coder/error inserter/ 
decoder combination. A constant input of all zeroes* 
was fed into one of the four most significant bit inputs 
of the experimental error-correcting coder, and the number 

*This is a valid simplification as the code is linear, i.e. purely 
additive operations are performed. 
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Fig. 9- The experimental 8-bit p.c.m. video error-correcting coder 



of 1's occurring at the corresponding output of the decoder 
was measured. The rate at which these 1's occurred was 
the decoded error rate p. (see Section 3.2). A graph 
of p. against p, the transmission-path error-rate simulated 
by means of the error inserter, was plotted (Fig. 12). 
The line corresponding to the simple theory given in 
Section 3.2 and the Appendix, Section 7.1, p^ = a(3p^, 
with the appropriate values of a and j3 is also shown. 

The experimental curve agrees fairly well with the 
theory. Discrepancies at high and low error-rates may 
be noted; in both cases it appears that the codec performs 
better than predicted by theory. The discrepancy at the 
low error-rate is caused by the error inserter not producing 
truly random errors. At very low rates the minimum 
period occurring between errors is greater than the time 
occupied by four blocks of data; when this state obtains, 
no code failures occur. As this condition is approached. 



the decoded error rate will fall short of the theoretical 
value (which assumes truly random errors). 

A small discrepancy at high error rates may result 
from two over-simplifications of the theory: 

(i) p may no longer be assumed small; 

(ii) code failure may be caused by any multiple combination 
of errors within four successive blocks, not just pairs 
of errors, as considered in the simple theory. 

Effect (i) would reduce the observed output error 
rate compared with the simple theoretical predictions; 
effect (ii) would increase it. 

4.6 Practical difficulties 

No difficulty whatever was experienced in the const- 
ruction of practical Wyner-Ash 'basic coder and decoders'. 
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Fig. 10 - Basic Wyner-Ash (8,7) decoder 



As Figs. 8 and 10 show, they are not very complicated; 
this was, of course, one reason for choosing the Wyner- 
Ash (8,7) code. 

The multiplexing and de-multiplexing circuits required 
fairly careful attention to clock-pulse timing, but the 
greatest problems were encountered with the stability 
of serial-to-parallel and parallel-to-serlal conversion. The 
main difficulty arose in generating and distributing the 
necessary 1 14 IVIHz clock pulses. 

A general area of difficulty not pursued in this work 
was synchronisation. This subject splits into three topics 
relevant to the present device. 

(i) 114 MHz clock regeneration at the decoder; 

(ii) synchronisation of the parallel-to-serial and the serial- 
to-parallel converters, i.e. 'word-framing'; 

(iii) synchronising the multiplexing and de-multiplexing 
operations so that parity may be separated from data, 
i.e. 'parity-framing'. 

These difficulties were avoided in the experimental 
device by means of direct links between coder and decoder. 
Further exploration of these topics would be required for 
a service codec where such direct links would not be available. 



5. Conclusions 

A survey of block and convolutional error-correcting 
codes has indicated that a Wyner-Ash convolutional code 
is nearly as efficient as a Hamming block code of similar 
redundancy and is less complex to instrument. 

The Wyner-Ash (8,7) code, with interlacing as des- 
cribed in this report, requires moderate redundancy and 
gives suitable protection for digital video signals up to 
an error rate of about 1 in 10. An experimental codec 
of this type has been constructed and applied to 8-bit 
p. cm. video signals to gain experience in the general 
field of error correction; it was confirmed by objective 
measurements that the performance was in accordance 
with predictions. A description of the subjective perfor- 
mance for both d.p.c.m. and p.c.m. video signals is given 
in a companion report. 

No serious practical difficulties were met in the 
basic coders and decoders which operate at the relatively 
slow speed of parallel bit-streams. Problems did arise 
however in the parallel-to-serial and serial-to-parallel con- 
verters where satisfactory generation and distribution of 
the high bit rate clock pulses (114 Mbit/s) was found to be 
difficult to achieve. 
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F/g. 11- The experimental 8-bit p.c.m. video error-correcting decoder 



The work did not cover certain aspects of digital 
transmission such as word synchronisation and parity 
framing. These will be investigated in future experiments 
in which digital video signals will be transmitted over a 
Post Office 120 Mbit/s transmission circuit. 
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7. Appendix 






7.1 Error probability analysis for single-error-correcting 
codes 

f 
As described in Section 2.|, a decoding failure results 
when two or more bits are in error within the groups* of 
bits indicated in Fig. S. The following analysis derives the 
probability of such decoding failures, p , in terms of the 
transmission-path error probability, p. (As mentioned in 
Section 3.2, the probability of erroneous bits in the decoded 
data output = p^ = a p where a is a small factor « 3)). 
It will be assumed that p is small, and only the occurrence 
of two bits in error per group will be considered. For 
convenience, a decoding failure will be defined as occurring 
when the first of the two erroneous bits causing the 
decoding to fail is received. 

Let A. be the event 'an isolated error in the trans- 
mission path has occurred at time /' 
Let B-- be the event 'another error has occurred in 
the transmission path at time (/+/), i.e. at / clock 
pulses later' 

Let Cj be the event 'decoding fails as a result of 
event 1 
Let 



Ji 



D'. be the event 'decoding fails at time /' 



Use the notation thatP(X) is the probability of occur- 
rence of event X, andPIY/X) is the conditional probability 
of Y given that event X has occurred. 



errors. Two errors of spacing / can be placed in any of n 
positions relative to the block structure. Both errors 
will fall in the same block in («-/) of these positions; all 
the n positions are equally likely so that: 



P{C../B.. 



- («-/) 



for 1 </<n 



By definition, / = is not of interest, and if / > n 
ecoding failure results so that P(C--/B..) = for / >n. 

p^, for a block code can now be determined: 



p^ i:p^c../b..) 

o (n-1) 



J^. 



(«-1)n 



Clearly, P(A.) 
and P(B Ik.) 

P(b'..) 



P 

P{B../A.)-P{A.) 
P 



For a given code, P^C-j/B-^) is a function of / only; 
it is related to the group structure of Fig. 5. 



p(c^,)=p(c^,/B^,)-mp 



-P(^jii^ji)-P^ 



If any C^ occurs, then D. will occur, so that: 



= P'E^(VB..) 



This is the probability of a decoding failure at time 
/, and as P(C.-lB-.) is independent of ;', P(D.) is also. It 
follows thatPlD^.j =p^, the required probability. 

/'(Cj/B.p will now be determined. Whether a pair 
of transmission errors causes a decoding failure depends 
on where they lie relative to the block structure of the code. 

Consider first a block code of block length n. A 
decoding failure results if any given block contains two 



*A 'group' (in Fig. 5) is a block for a block code and A' consecutive 
blocks for a convolutional code 



I.e. p^ 



(«-1) 



or o 



|3p^ where |3 = -'-"~-^ 



2 ^ 2 

For a convolutional code of block length n and con- 
straint length N a decoding failure results if any group of 
N consecutive blocks contains two errors. If / < , 

[n^N—^)—^] the two errors with spacing/ must always fall i 
within some group of N consecutive blocks so that 

P(C.,./B^.,.) = 1 for 1</< [n(N-\)-n 

When j > n (N—'\) the errors can fall so that no decoding 
failure results; a similar argument to the one given above 
for a block code shows that: 



^/J 



P(C^,/B..) 



isi^zL?) forn{7V-1)</<«A^ 



For; > nN no decoding error results. 



Thus, for a convolutional code. 

[n(7V-1)-1) 



= [n(7V-1)-1] 



/=1 
n 

+ E - 

r 
x=0 



nN 
j=n (N- 1 ) 



{nN-D 
n 



(using substitution/ = 

/2(yv-i) + x) 



(L.i-'^- . Ij • 



'V'> 7,'. 
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= [«(iV-1)-1] + (n+1) 
= «(A^-1)-1 + ^^ 

2 

_ «(2Af-1)-1 
2 



(«+1)n 



Thus, 



or 



Pc=^<Di)=p' E ^(C/A-^' 



. n(2A^-1)-1 . „2 
2 



p =|3p^ where P = "'^^~'" "'' 



These results are also obtained in Reference 11, 
using a different method. Note that a different notation 
is used in Reference 1 1 as shown below 



« = «„ (block code) 
Nn = n. (convolutional code) 
n = b (convolutional code) 



7.2 Operation of Hamming Codes 

A demonstration will be given of the operation of 
one Hamming code - the (7, 4) code - by way of example; 
the extension to the general case will then be indicated. 



Note: (i) c- b. a. is the binary representation of the num- 
ber/; 
(ii) for values of/ corresponding to parity bits, one, 
and one only, of c, b-, a. is a 'I'.* For every bit, 
data or parity, at least one of a., b., c, is a 'I'. 



The values D. for data bits are known, as these 
represent the input mformation. The parity bits are formed 
so that the following equations are satisfied: (N.B. addition 
is modulo-2; this will apply thoughout Sections 7.2 and 
7.3). 



= 



E 


a.D. 


/=i 




7 




E 


b.D. 


/=i 




7 




E 


'i^i 


/=i 





Eqns. 7.2.1. 



These three simultaneous equations enable the three 
unknowns, the parity bits, to be determined. As a result 
of the conditions noted in (ii) above, each parity bit occurs 
multiplied by non-zero coefficients in only one equation, 
and only one parity bit in each equation. It follows that 
each parity bit is formed independently of the others as a 
simple summation of some data bits - i.e. a normal parity 
check but performed on a selection only of data bits. 

Now suppose that the seven bits D^ to D^ are trans- 
mitted over the communication circuit and that the seven 



bits D' to D' are received. 



Define S 



S^, S^ as follows: 



The Hamming (7, 4) code is a systematic block code, 
so that each transmitted block of seven bits contains four 
data bits and three parity bits; each such block may be 
considered independently of all others. 

Consider one such block. Suppose that the bits 
within the block are labelled by the numbers/ = 1 to 7 and 
that the value of bit / is denoted by D.. Bits 1 , 2 and 4 
are parity bits and coefficients a-, b., c. are defined as shown 
below: 



'l 


'i 


a. 


/ 


Bit value 


Bit represents 








1 


1 


^1 


Parity 





1 





2 


^2 


Parity 





1 


1 


3 


^3 


Data 


1 








4 


^4 


Parity 


1 





1 


5 


^5 


Data 


1 


1 





6 


^6 


Data 


1 


1 


1 


7 


D-, 


Data 



1 JLj j j 

^2 = E h^; 

^3 = E ^/^/ 

/=1 



.... Eqns. 7.2.2. 



Note the similarity between Eqns. 7.2.1 and 7.2.2. 

If the block is received correctly so that D'. = D. for all 

values of /, then S^ = S^= S^ = 0. Now suppose that the 

fc.. bit only has been received in error so that: 
th ' 



D.' = D..i^k 



^k 



^;t + i 



The ability of the code to correct this single error 
will now be shown. Substituting the values for D.' in the 
equations: 

*This implies/ is a power of two 
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^1 = E «/^/ = E «/^/ + «.-i 



/=i 



/=i 



7.3. Operation of Wyner-Ash codes 

A simple description of the (8,7) Wyner-Ash code has 
already been given in Section 2.7.2; the operation of this 
code will now be analysed. 



and similarly 



The code has constraint length TV = 4 so that each 
transmitted block has seven data bits and one parity bit, 
but this parity bit relates to the data information of four 
blocks altogether. 



Thus S^ S^ S^ = c^ b, a^, which is the binary repre 
sentation oik (condition (i) above) ~' 



erroneous bit is thus determined; 
the error. 



The position of the 
it is inverted to correct 
If it has 



iSg S„ S. is known as the syndrome, 
the value 000 no error has occurred. 



The failure of the code on double errors may be shown. 
Suppose errors occur in both bits k. and k„. The syn- 



drome bits will be: 



"^2 = 



^3 - 



+ a,. 



+ b. 



2- 



say 



•), say 
'^3 



-I- c 



k " '^k ^^V 



The syndrome c^^ bj^^ a^^ is thus formed; the decoder 
will conclude that bit k^ is in error and "correct" it. 
However, as 



fc^ 7^ # ^2 



Let the value of the /th bit of the /th block be 
denoted by DAI), and define coefficients a., 6,., c, and 
d. as shown in the table below: 



/' r 



'l 


'i 


b. 


v j 




















1 


1 





1 





2 





1 • 


1 


3 


1 








4 


1 





1 


5 


1 


1 





6 


1 


1 


1 


7 



Note that: |i) all values of a. = 1 

(ii) d. c. b. is the binary representation of the 
number/. 



Place the parity bit in the 0th position in each block so that 
all DAI) are parity bits. The equation which specifies the 
parity information for the code is: 



it follows that 



k^ --^ k^ ¥= k^ 



so that after decoding, bits k., k„ and A:„ will be in error. 



/•=o /=0 



The general case of (n,k) Hamming code is a simple 
extension of the above analysis. There will he m = {n-k) 
parity bits which are placed in positions/ where/ is a power 
of two. There will be n equations defining parity bits, with 
m coefficients .... e., d., c, b-, a. where . . . . e.d.c-b-a. 
is the binary representation of /. The syndrome win 
contain m bits and will in the same way indicate the position 
of a single error. 

Finally, it will be clear to those acquainted with 
matrix algebra that simultaneous equations such as have 
occurred in this analysis, each containing summations over 
a range of coefficients, may be concisely expressed in 
matrix form. 



+ E ^/^/"-2) +^ d.D.(l-3) = ....7.3.1. 

/•=o /=0 



for all values of/. 

This defines the parity bit of the /th block, D^U), in 
terms of the data bits of blocks, /, (/-I), {1-2), and (/-3). 
The previous parity bits are not involved as ^q = Cq = (i^ = 0. 



Now suppose that the bits DAI) are transmitted over 
the communication circuit, and that bits D.'il) are received. 
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Define a syndrome bit* for each block by the equation: 

7 7 7 7 

S(l) = E '^jD/d) + E b.D/il-^) + ^ c.Z).'(/-2) + E d.D.'(l-3) for all values of / 7.3.2. 

/=0 /=0 /=0 /=0 

If no errors occur during transmission then: 

D.'il) = D.{1) forall/, /and thus, comparing 7.3.1 with 7.3.2., 5(/) = Oforall/. 

Now suppose an isolated error occurs in bit k of the j'th block so that 

Df^'iy) = Dj^[y) + 1 
and Djd) = D.(l) for all (/,/) except (fcj^). 

Substituting these values in the equations above it may be seen that 

for I < y S(l) = 

and for / > ;; + 4 S{1) = 



S(y) = E "f^/W + E b.D:{y-^) + E c.i).>-2) + 2] d.D:{y-3) 
/=o /=b /=o /■=o 



7 7 7 7 

«;t-1 + E ^/^yW + E ^■^;t>'-1) + E ^/^/(J'-2) + E cl.D.{y-3) 
/=o /=o /=o /=0 



«;fc + = «;t = 1 



■^0^+1 ) = E «/^/(y+i) + E ^-^/W + E c.D.'{y-^) + E rf/^/(>'-2) 

/=0 /=0 /=0 /=0 

7 7 7 7 

= E «;^;(y+1) +E ^;^y(y) + *^-1 + E c.Z).(y-1) + J] d.D.{y-2) 
/"=0 /=0 /=0 /=0 

= h 

and similarly 

5(y+2) = c^, S(y+3) = d^. 

*lt can be shown that this is identical with the alternative definition given in Section 2. (It follows from the similarity between 7.3.1 and 7.3.2.) 
(EL-99) -20- 



Note that S{y) is the first syndrome bit S{1) which 
takes the value 'I'. It is interpreted as indicating that the 
error occurred in this block. This property results since 
a. = 1 for all /so that 51/) acts as a simple parity check of 
block (/) if there have been no errors in previous 
blocks. 



S{y+3), S(y+2). S(y+'\) are d^, c^, &^ respectively. 
Note that d, c. b, is the binary representation of k. 
The syndrome bhsS(y+3),S{y+2),S(y+^) thus indicate the 



position of the error within block j, this block having been 
identified by being the first to have a syndrome bit = 1. 

The analysis presented above extends to higher {n,k) 
Wyner-Ash code by having more coefficients . . . . gj fj Cj 
d. c. b. a., where a. = 1 for all values of/ and the remainder 
is the iDinary representation of/. The equations will now 
contain A^ summations over N blocks, the summation for 
each block having the range / = to («— 1 ). 

Once again a more concise presentation may be 
achieved with matrix algebra. 



CLA/AMM 
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